An Escape-Time Criterion for Queueing Networks: Asymptotic Risk-Sensitive Control via Differential Games
نویسندگان
چکیده
We consider the problem of risk-sensitive control of a stochastic network. In controlling such a network, an escape time criterion can be useful if one wishes to regulate the occurrence of large buffers and buffer overflow. In this paper a risk-sensitive escape time criterion is formulated, which in comparison to the ordinary escape time criteria penalizes exits which occur on short time intervals more heavily. The properties of the risk-sensitive problem are studied in the large buffer limit, and related to the value of a deterministic differential game with constrained dynamics. We prove that the game has value, and that the value is the (viscosity) solution of a PDE. For a simple network, the value is computed, demonstrating the applicability of the approach.
منابع مشابه
Risk-Sensitive Control for Systems with Input Delays
The partially observed risk-sensitive optimal stochastic control of a system with multiple time-delays in input, which minimizes the expected value of an exponential cost criterion, is considered. The change of measure technique is used to obtain the sufficient statistics of the cost criterion given the measurement history, which is called the information state. The information state helps to c...
متن کاملExplicit Solution for a Network Control Problem in the Large Deviation Regime
We consider optimal control of a stochastic network, where service is controlled to prevent buffer overflow. We use a risk-sensitive escape time criterion, which in comparison to the ordinary escape time criteria heavily penalizes exits which occur on short time intervals. A limit as the buffer sizes tend to infinity is considered. In [2] we showed that, for a large class of networks, the limit...
متن کاملRisk-Sensitive Control for the Parallel Server Model
A Markovian queueing model is considered in which servers of various types work in parallel to process jobs from a number of classes at rates μij that depend on the class, i, and the type, j. The problem of dynamic resource allocation so as to minimize a risk-sensitive criterion is studied in a law-of-large-numbers scaling. Letting Xi(t) denote the number of class-i jobs in the system at time t...
متن کاملOptimal Control of Stochastic Networks - an Approach via Fluid Models
We consider a general control problem for networks which includes the special cases of scheduling in multiclass queueing networks and routing problems. The fluid approximation of the network is used to derive new results about the optimal control for the stochastic network. The main emphasis lies on the average cost criterion, however the β-discounted as well as the finite cost problem are also...
متن کاملAsymptotically optimal control for a multiclass queueing model in the moderate deviation heavy traffic regime∗
A multi-class single-server queueing model with finite buffers, in which scheduling and admission of customers are subject to control, is studied in the moderate deviation heavy traffic regime. A risk-sensitive cost set over a finite time horizon [0, T ] is considered. The main result is the asymptotic optimality of a control policy derived via an underlying differential game. The result is the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Math. Oper. Res.
دوره 28 شماره
صفحات -
تاریخ انتشار 2003